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Abstract 



The aim of the present paper is to study the regularity properties of the solution of a 
backward stochastic differential equation with a monotone generator in infinite dimension. 
We show some applications to the nonlinear Kolmogorov equation and to stochastic optimal 
control. 

> 

oo 

^ ! 1 Introduction 
m . 

. In this paper we are concerned mainly with backward stochastic differential equations (BSDEs 

for short in the remaining of the paper) in infinite dimension in the markovian framework. More 
precisely, we consider the following backward stochastic evolution equation: 



=3' { dY, = Z,dWr-ll>{T,Xr,Yr,Z,)dT, T ^ [t,T], 

•rH . where is a cylindrical Wiener process in some Hilbert space r,. The unknowns are the 

r> I processes Y and Z; Y takes its values in a Hilbert space K and Z belongs to L2{'^,K), the 

' space of Hilbert- Schmidt operators from H to K. The process X takes its values in a Hilbert 



space H and is the solution of the forward equation 
dXr = AXr 

Xt = xe H, 



dXr = AXrdT + F{T,Xr)dT + G{T,Xr)dWr, Te[t,T], 



where A is the generator of a strongly continuous semigroup of bounded linear operators {e*"^} 
in H, F and G are functions with values in H and H) respectively, satisfying appropriate 
Lipschitz conditions. 

The above equations and (|1.2|) form a so called forward-backward system. Under 

suitable assumptions on F, G and ^, there exists a unique adapted process (X, Y, Z) in the 
space H X K X L2(H,K) solution to this system. The processes X,Y,Z depend on the values 
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of X and t, occurring as initial conditions in (|1.2|) : we may denote them by X{T,t,x), Y{T,t,x), 

Z{T,t,x),Te[t,T]. 

The goal of this work is the study of the continuity and differentiability with respect to the 
parameters t and x of the process Y solution to the BSDE when the coefficient ijj in 
is a monotone operator (see Theorem 14.3(1 . 

We show, moreover, some interesting applications of this result to the solvability of nonlinear 
stochastic Kolmogorov equations and to stochastic optimal control problems. 

BSDEs in finite and infinite dimensions have been intensively studied in recent years, starting 
from the paper by E. Pardoux and S. Peng [15| : we refer the reader to jlUj . [HI and jl4j for an 
exposition of this subject and to [12] for coupled forward-backward systems. 

The problem of regular dependence of the solution of a stochastic forward-backward system 
has been studied in finite dimension by Pardoux, Peng |16j and by El Karoui, Peng and Quenez 
|lUj . and, in infinite dimension, by Fuhrman and Tessitore in [7j, [S]. In both cases, ip is assumed 
to be Lipschitz continuous with respect to y and z. We will assume on a weaker condition: ip 
will be Lipschitz continuous only with respect to z and monotone with respect to y in the spirit 
of the works ^7], ^Sl ^-^d more recently 

We should point out that, since we are working in infinite dimensional spaces, the derivatives 
are understood in the Gateaux sense: for instance Nemytskii (evaluation) operators are not 
Frechet differentiable, except in trivial cases. 

This result, beside its intrinsic interest in the framework of the theory of BSDEs, allows 
us to treat nonlinear partial differential equations as the well known Kolmogorov equation: for 

t G [0, T] and xe H, 

dtv{t, x) + Ct[v{t, ■)]{x) + V(t, X, v{t, x),G{t, xyv^v{t, x)) = 0, v(T, x) = cj){x), (1.3) 
where Ct is the operator associated with the coefficients A, F and G in (|1.2|) . namely 

CtHx) = \ Trace {G{t,x)G{t,xYV^<p{x)) + (x, A*V0(x))// + {F{t,x),V<l){x))H- (1-4) 

Important results concerning connections between BSDEs and PDEs have been stated by 
Pardoux and Peng P!B^ and Peng ^7], ^H], [19| . j2Uj in the Markovian case: these Markovian 
BSDEs give a Feynman-Kac representation formula for nonlinear parabolic partial differential 
equations. Conversely, under smoothness assumptions, the solution of a BSDE corresponds to 
the solution of a system of quasilinear parabolic PDEs. 

One of the main results of this paper, Theorem 15. 3( specifies conditions for unique solvability 
of equation (|1.3() . As usual, if we define the function v by the formula v{t, x) = Y{t, t, x), where 
Y{-,t,x) is the solution to BSDE then it turns out that the function v is deterministic 

and it is a solution of the nonlinear Kolmogorov equation. Various concepts of solutions are 
known for (linear and) nonlinear parabolic equations in finite and infinite dimensions. Many 
investigations have been carried out in connection with the Hamilton Jacobi Bellman equation 
arising in optimal control for nonlinear infinite dimensional stochastic systems. One possibility 
to deal with equation H1.3|) is to look for classical solutions, see e.g. ^H] or ^Hj, i.e. functions 
which are twice differentiable with respect to x and once with respect to t, such that C[v{t, •)] 
makes sense for every t G [0, T] and (jl.3j) holds. This requires heavy assumptions on the 
functions ip and 4>, involving existence of derivatives up to order two as well as trace conditions on 
second derivatives. Another possibility, in some sense opposite, is to consider viscosity solutions. 
Existence and uniqueness of viscosity solutions can be proved under much weaker assumptions 
on the coefficients in the finite dimensional case, see e.g. ^Hl- However, the theory of viscosity 
solutions is much harder in the infinite dimensional case. Moreover, in view of applications 



2 



to optimal control theory, it is important to show the existence of VxV, since this allows to 
characterize the optimal control by feedback laws. In this paper we will consider solutions in 
the so called mild sense (already considered in the literature, see jl], and references within, 
and, in connection with the backward stochastic equations approach, [Jj, [H]). Namely a mild 
solution V of equation will satisfy the equality, for t £ [0, T] and x £ H, 

v{t,x) = r Pt,M{T,-,v{T,-),G{T,-rVMrrmx) dr + Pt,T[4>]{x). 



which arises formally from ()1.3|) as the variation of parameters formula. We notice that this 
formula is meaningful provided v is only once differentiable with respect to x and, of course, 
provided tp, v and V^.^ satisfy appropriate measurability and growth conditions. Thus, mild 
solutions are in a sense intermediate between classical and viscosity solutions. We can prove 
existence and uniqueness of a mild solution v by requiring existence and boundedness (or growth 
conditions) of first derivatives of ^ijj and 0: compare Theorem 15.31 

As mentioned above, results on system ()l.ip - H1.2() are suitable for applications to problems 
of nonlinear stochastic optimal control. Let us consider a controlled Markov process X" in H, 
on a time interval [t, T] C [0, T], described by an Ito stochastic differential equation of the form: 

dX^ = AX^ ds + F(s, X^) ds + G(s, X^)[r{s, X^, u,) ds + dWs], s G [t, T], 
Xf = x£ H, 

where the control process u takes values in a given subset U <ZU . The aim is to choose a control 
process n, within a set of admissible controls, in such way to minimize a cost functional of the 
form: 



J{t,x,u) = E 



exp(^y X{r,X^,Ur)drjl{s,X^,Us)ds + exp\^J X{r, X^ ,Ur)dr ] (j){X^) 



where X,l,(j) are real functions. A may be called the discount function. The Hamilton Jacobi 
Bellman equation for the value function is of the form H1.3|) . provided we set 

il){t, X, y, z) = inf [/(t, x, n)+ < r(t, x,u),z > +A(t, x, u)y] . 

The control problem is understood in the usual weak sense (see "O" and Subsection 15.21 below). 
The distinctive feature of our case is the fact that v occurs explicitly in the Hamilton Jacobi 
Bellman equation (not only through its derivatives) in a nonlinear way whenever A effectively 
depends on u (i.e. we have the control on the discount). In particular, if we take r bounded 
and A non positive, we obtain a coefficient ip monotone with respect to y and Lipschitz with 
respect to z. Remarks on this special case of Hamilton Jacobi Bellman equation are in the 
classical books by Bensoussan [T| and Bensoussan-Lions j2], but they require A to be bounded. 
Puhrman and Tessitore [Jj, [HI deal with a similar optimal control problem in infinite dimension, 
but in their applications the Hamilton Jacobi Bellman equation depends at most linearly on v. 
Under suitable conditions, if we let v denote the unique solution of the Hamilton Jacobi Bellman 
equation, then we have J{t,x,u) > v(t,x) and the equality holds if and only if u and X" satisfy 
a suitable feedback law. Thus, the optimal control u is related to the corresponding optimal 
trajectory X"^ by a feedback law involving VxV. One of the main results of this paper is the 
characterization in this case of the optimal control by a feedback law (Theorem I5.6|l . To this 
end we use the previous results to guarantee existence, uniqueness and regularity of the solution 
of Hamilton Jacobi Bellman equation. 

The plan of the paper is as follows: Section is devoted to notations. In Section |31 we 
state our main result concerning the differentiability of the solution to a BSDE with respect 
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to the data. In Section 01 we apply the previous results to study the regularity of the map 
{t,x) I — > {Y{-,t,x), Z{-,t,x)) solution of the forward-backward system Hl.l|l - H1.2|l . The last 
section contains the applications to PDEs: in particular, we study the nonlinear Kolmogorov 
equation and we give some applications to optimal control. 



2 Notations 

2.1 Vector spaces and stochastic processes 

The norm of an element x of a Banach space E will be denoted \x\e or simply |x| if no confusion 
is possible. If F is another Banach space, L(E, F) denotes the space of bounded linear operators 
from E to F endowed with the usual operator norm. 

The letters H, H, K will always denote Hilbert spaces. Scalar product is denoted (•, •), with 
a subscript to specify the space if necessary. All Hilbert spaces are assumed to be real and 
separable. L2(H,X) is the space of Hilbert-Schmidt operators from to K endowed with the 
Hilbert-Schmidt norm. 

By a cylindrical Wiener process with values in a Hilbert space H, defined on a probability 
space (0,.?-", P), we mean a family W{t), t > 0, of linear mappings from H to such that 

(i) for every G H, {W{t)u, t > 0} is a real (continuous) Wiener process; 

(ii) for every n, u G H and t > 0, E {W{t)u ■ W{t)v) = {u,v)s- 

In the following, all stochastic processes will be defined on subsets of a fixed time interval 
[0, T]. {^t}te[OT]^ ^i^l denote, except in Subsection 15. 2| the natural filtration of W, augmented 
with the family M of P-null sets of J-t- 

Tt = o[W[s) ■ s G [0,t]) VAA. 

The filtration {^t}t£[QT] satisfies the usual conditions. All the concepts of measurability for 
stochastic processes (e.g. predictability etc.) refer to this filtration. For [a, b] C [0, T] we also 
use the notation 

Tia,b]=<T{W{s)-W{a) : se[a,b])VAf. 

By V we denote the predictable cj-algebra on 17 x [0, T] and by B{A) the Borel cr-algebra of any 
topological space A. 

Next we define several classes of stochastic processes with values in a Hilbert space K. 

• (17 x[0,T];K) denotes the space of equivalence classes of processes Y £ L'^{Qx [0, T]; K), 
admitting a predictable version. Lj,{Q x [0,T];/C) is endowed with the norm 



T 



\YrfdT 



AdP{K) := L^{Q; L'^{[0,T]; K)) denotes the space of equivalence classes of processes Z 
such that the norm 



ll^l|2,p = IE 

is finite, and Z admits a predictable version. 



1/p 
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C-p{[0,T];L'^{Cl;K)) denotes the space of valued processes Y with a predictable modi- 
fication such that Y : [0,T] L'^{Cl;K) is continuous, endowed with the norm 



\Yf = sup E|y^|2 
re[o,r] 



Elements of C-p([0, T]; L^(J7; K)) are identified up to modification. 

S^{K) := C([0, T];K)) denotes the space of predictable processes Y with continuous 

paths in K, such that the norm 



I ||oo,p — 



1 1/p 



is finite. Elements of SP{K) are identified up to indistinguishability. 
If y is a process in K, we will use the following notations: 

\Y\i = £ \Ys\ ds, |y|oo = supig[o,T] \Yt\, \Y\2 = 

Given an element ^ of L|,(17 x [0,T]; L2{E, K)), one can define the Ito stochastic integral 
J^^{a)da, t G [0,r]; it is a i^-valucd martingale belonging to L|,(S1; C([0, T]; K)). 

The previous definitions have obvious extensions to processes defined on subintervals of [0, T]. 

2.2 The class g 

In this subsection, X, Y, Z and V denote Banach spaces. We recall that for a mapping F : 
X ^ V the directional derivative at point x e X in the direction h e X is defined as 

,N F(x + sh)-F(x) 
VF(x; h) = lim — ^ 

whenever the limit exists in the topology of F. F is called Gateaux differentiable at point x if it 
has directional derivative in every direction at this point and there exists an clement of L{X, V), 
denoted VF{x) and called Gateaux derivative, such that VF{x] h) = VF{x)h for every h & X. 

Definition 2.1. We say that a mapping F : X ^ V belongs to the class Q^{X;V) if it is 
continuous. Gateaux differentiable on X, and V-F : X — > L{X, V) is strongly continuous. 

The last requirement of the definition means that for every /i € X the map VF{-)h : X ^ V 
is continuous. Note that VF : X L{X, V) is not continuous in general if L{X, V) is endowed 
with the norm operator topology; clearly, if this happens then F is Prechet differentiable on X. 
Some features of the class {X, V) are collected below. 

Lemma 2.2. Suppose F G g^{X,V). Then 

(i) (x, h) ^ VF{x)h is continuous from X x X to V; 

(ii) IfGe g\V,Z) then G{F) e g\X,Z) and V(G(F))(x) = VG{F{x))VF{x). 
Lemma 2.3. A map F : X ^ V belongs to g^{X,V) provided the following conditions hold: 

(i) the directional derivatives VF(x; h) exist at every point x E X and in every direction h G X; 

(ii) for every h, the mapping VF(-; h) : X is continuous; 
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(iii) for every x, the mapping h ^ V-F(x; h) is continuous from X to V . 

The proofs of these lemmas are in We need to generaUze these definitions to functions 
depending on several variables. For a function F : X x Y ^ V the partial directional and 
Gateaux derivatives with respect to the first argument, at point (x, y) and in the direction 
h £ X, are denoted VxF{x,y; h) and VxF{x,y) respectively, their definitions being obvious. 

Definition 2.4. We say that a mapping F : X xY ^ V belongs to the class Q^'^{X x Y; V) if it 
is continuous. Gateaux differentiable with respect to x on X xY, and VxF : X xY ^ L{X, V) 
is strongly continuous. 

As in Lemma |2. 21 for F G Q^'^{X x Y, V) the map (x, y, h) i-^ VxF(x, y)h is continuous from 
XxYxXtoV, and analogues of the previously stated chain rules hold. The following result 
is proved as Lemma 12.31 (but note that continuity is explicitly required) . 

Lemma 2.5. A continuous map F : XxY belongs to Q'^'^{X x Y, V) provided the following 
conditions hold: 

(i) the directional derivatives 'VxF{x,y;h) exist at every point {x,y) G X xY and in every 

direction h €z X ; 

(ii) for every h, the mapping VF(-, •; /i) : X xY ^ V is continuous; 

(iii) for every {x,y), the mapping h 'VxF{x,y;h) is continuous from X to V. 

When F depends on additional arguments, the previous definitions and properties have 
obvious generalizations. For instance, we say that F: XxYxZ^V belongs to Q^'^'^{X x 
Y X Z;V) if it is continuous. Gateaux differentiable with respect to x and y on X xY x Z, and 
VxF : X xY X Z ^ L{X, V) and VyF : X x Y x Z ^ L{Y, V) are strongly continuous. 



3 Differentiability of BSDEs 

In this section we want to study the BSDE 

Yt = ^+ I ij{s,Xs,Ys,Z,)ds- [ ZsdWs, 0<t<T (3.1) 
Jt Jt 

where ^ is a given .T^j^-measurable random variable with values in K and Xr, r G [0,T], is 
a given continuous predictable process with values in H. To stress the dependence of the 
solution to the BSDE with respect to the terminal condition ^ and the process X, we will 
denote {Y{X, ^), Z{X,^)) the solution to p.ll) . The main point is to study the regularity of the 

map {X,0^{Y{X,0,Z{X,O)- 

ip : [0,T] X H X K X L2(H,i^) K is assumed to be a Borel-measurable function which 
satisfies moreover the following assumption: 

Hypothesis A.l. There exist some constants m>0, n>0, c>0, L>0 and /U G M such that 

(i) for every a G [0,r], x e H, y e K, zi,Z2 G L2{E,K), 

\ip{a,x,y,zi) - 'iJj{a,x,y,Z2)\ <L\zi- Z2I; 

(ii) for every fi G [0, T], x G -fT, z G -^^2(^5 K), y 1 — > Tp{a, x, y, z) is /u-monotone meaning that 

V(yi,y2) G K'^, {yi - y2,ip{o;x,yi,z) - i;{a,x,y2, z)) < fi\yi - y2\^ ; 
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(iii) for every a G [0,r], ^{a, ■,-,■) G G^^^^^{H xKx L2{^,K)). 

(iv) for every cr G [0, T], x G y G i^, z G L2(H,i^), 

\V^^{a, X, y,z)\ + iVyi^ia, x, y,z)\< q{a) + c (|xr + 1^1" + kP) 
where q G -^^"'^(0, T). 

(v) V(s) := V('5, 0,0,0) belongs to L^{^,T). 

Remark 3.1. It follows from HvDothesis lA. II . iii) and iv) that 

\'4){s,xi,yi,zi) - V'(s,X2,y2,^2)| 

< L |zi - Z2I + (ki - X2I + \yi - y2\) {q{s) + C (IxiP + |x2r + l^il" + W + kil')) • 



Consequently, we have 

\^{s,x,y,z)\ < L\z\ + (|x| + \y\){q{s) + C{\xr + Ij/D) + |V'(s,0,0,0 
For p > 1 we denote IC^ the Banach space 

}CP = SP{K) xMP{L2{E,K)) 

endowed with the norm 



(3.2) 



p/2 



Proposition 3.2. Lei i/ie assumvtion \A . 1\ hold. 

Letp>l and let ^ G LP{n;K), X G 5P("+^)(F). T/ie 5S'i?£^ JSU /las a unigue solution in 
JCP, {Y{X,0,Z{X,0), which satisfies 



{Yix,o, zix,0) \\p<c[i + m\p + 



oo,p(m+l) 



(3.3) 



for a suitable constant C depending only on p, T , L and fi. 



Proof. The proof relies heavily on the results given in |21 in the finite dimensional case. The 
generalization of these results to the case of a cylindrical Wiener process taking its values in an 
Hilbert space is immediate. 

Let X G 5P(™+1)(-^) and ^ G LP{il;K). Since the function ^ is Lipschitz with respect to 
z and //-monotone with respect to y. Theorem 4.2 in shows that the previous BSDE has a 
unique solution, {Y, Z) in /C^. Moreover, it follows from [H] [Proposition 3.2] that 



E 



snp,^[o,T]\Yr\'' + \Z^\^da^ < KK \C\p + \^P{a, X^,0,0)\da^ 



Hence, taking into account (|3.2|) we have. 



\\{Y,Z)l<K{l + m\, + \\X\ 



m+l 

oo,(m+l)p 



which is exactly (|3.3j) . 



□ 
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Let us introduce some further notations. For any p > 1, we denote by the product space 
5P(m+i)(i/) X LP{Q; K) and we consider, according the previous proposition, the map $ from 
to /CP defined by = {Y{X,i),Z{X,i)) where {Y{X,i),Z{X,i)) stands for the solution 

to the BSDE 

Proposition 3.3. Let the assumvtion \A . 1\ hold and let p^, = max(2,n) + ^^^qrj. 

(a) If p > p*, the map ^ is continuous from X^ to K7 where r = p/p*. 

(b) //p > p^, + max(np*, 2), ^ belongs to {X'^ , IC^) withr=p/p^ and p = r min 2^ 

Moreover, for all (X, ^) G X'p, the directional derivative of in the direction (N, (") G X^, 
Vx,^^iX,Oi^^C) ^-s the unique solution {G,H) in K7 to : 



Gt+ / H^dW, 



C + V,V(fT, X„, Y^iX, 0, Z^iX, 0)iV, da 
+ Vj.V'l^T, X„ , (X, , Z„ (X, ) G<x da 
+ £ V,V(fT, X^, Y^iX, 0, Z^iX, C))H^ da. 



(3.4) 



Finally the following estimate holds 
\\Vx,cm,OiN,C)l.<K 



+ l|iV| 



oo,p(m+l) 



i + iieiir' + 11^11^ 



{■m+l)(nV2) 
oo,p(m4-l) 



(3.5) 



Proof, (a) Let us assume that p > p^ and let us set r = p/p* > 1. Using Proposition 3.2 in 0, 
we have, if {Y, Z) = $(X,0 and {Y', Z') = ^{X',^') where (X,^) and {X',^') belongs to X^, 



|(y,z)-(y',z')||; < CE 

< CE 

< CE 



- + (^^ IV'Cs, ^s, K,, Zs) - il>{s, X',,Ys, Z,)\ ds^ 



oo 



i+i^ir+i^ir+i^c+i^ 



l2r 



ri \ 'mr 
I oo 



|2r 



Using Holder's inequality, we deduce that 

||(y, z) - {Y',z')\l <c(\\i- ^'11, + \\x - x'\ 

with A given by 



oo,p(m+l) 



X A 



4 — -1-11"!^' II™ J-IIVll"- 

— i ||oo,M{m,r) "T 11^ lloo,«(m,r) lloo,M(n,r) "T II ^ II 2,u(2,r) 

where, for any a > 0, ti(a, r) = a^^f^^pjji^ = «2vn- ■'^^ follows that \\{Y, Z) — {Y' , Z')\\^ is bounded 
from above by, up to a multiplicative constant C, 

Ik ~ ^'\\p + 11^ ~ "^1L,p{m+l) + II^IIS,p(m+l) + ll^1loo,p(m+l) + II^IISo,p + ll^ll^p 

This gives the continuity of ^. 

(b) Let us assume now that p > + max(np*,2) and let us define r = p/p* together with 



p = rmm\^,^ 



mm 



p,(n+l) ' 2+p, 



> 1. 
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Let us pick {X,S^) and {N,() in and, for simplicity, let us denote by T the triple 
{X,Y,Z) = {X,^{X,^)). We consider the BSDE 

Gt = C+ [ V^^Pis,Ts)Nsds+ [ Vy^{s,Ts)Gsds+ f V,^{s,Ts)H,ds- f HsdE.,. 
Jt Jt Jt Jt 

Let us observe that 

r \V,i,{s,T,)Ns\ ds < K\N\^ (|g|i + \X\Z + \Y\^ + \Z\l) 
Jo 

and arguing as before with Holder inequality we deduce that 

l/r 



< -f^ll^lloo,p{m+l) ( 1 + l|-''^IIS,p(m+l) + II^IISo.p + ll^lli.p) • 



Moreover, we have, since %[) is Lipschitz with respect to z and /^-monotone with respect to y, 

I V,V(s, Ts){h-h')\<L\h- h'\ , [g - g', Vyi^{s, T,) [g - g')) ^ < ,^\g - g'\\ 
It follows from 3 that the previous BSDE has a unique solution (G, H) in /C such that 

ii(G, H)\\r < K (iicii. + iiiviioc,Km+i) (i + my^oAm+i) + \\nroo,p + \\z\\ir)) ■ 

Taking into account the inequality (|3.3() . we deduce that 

ii(G, H)\\r<K (iiciip + iiiviioo,p(m+i) (i + iieiir' + mttl^Ti?)) ■ (3-6) 

It remains to prove that the directional derivative of <I> at {X, ^) € in the direction 
(TV, C) e is given by (G, H). For e > 0, we set X" = X + eN and we consider {Y^ , Z") the 
solution in KP to the BSDE 

y/ = e + eC+ r Hs,Xl,Y,^,Zl)ds- r ZldB,. 
Jt Jt 

Before going further, let us introduce the following notations: Uf = {Y^ — Yj) — Gt and 
Vi = {Zf - Zt) - Ht. We have, 

Ut = -J'\iP{s,XlY!,Zl)-i;{s,X,,Ys,Zs))ds- j\!dB, 

- I VMs,Ts)Nsds- I Vyi;{s,T,)Gsds- [ V,'iPis,Ts)H,ds. 
Jt Jt Jt 

Using the fact that ipis, •, •, •) belongs to G^'^'^, we can write 

^ Ws, xi,Y!, ZD - x„ y„ z,)) = a\ + b\ + ci 

where A% G L{K, K) and G L (L2(H, i^), K) are defined by 

VyGK, A^y= l\yij{s,XlY, + a{Y^ -Ys),Zs)yda, 
Jo 



VzGL2(H,K), Blz= [ V,ij{s,Xl,Y^',Zs + a{Zl - Zs))zda 

Jo 



and where 



1 

CI = - {i;{s, Xl,Ys,Zs) - Hs, Xs,Ys, Z,)) = / V,V(x, + aeiV,, F,, Zs)Ns da. 
^ Jo 

Then V) solves the following BSDE 

Uf = r {AlUt + BlV!)ds+ r {P'is) + Q'is)+R'{s))ds- V,' dB, 
Jt Jt Jt 

where we have set 

P'{s) = {Al-Vyi^is,Ts))Gs, Q'is) = {Bl-VMs,T,))H,, 

together with 

R'{s) = [ V^ij{x,Xs + aeNs,Ys,Zs)Nsda-V^i;{s,Ts)Ns. 
Jo 

Since {y,Al y) < and {B^zl < L\z\, we can apply Proposition 3.2 in to learn that, 

\\{u',vn\i< K [\\\p^ui+\\m^i+\\\R%i^ 

for a suitable constant K depending on L, fi, T and p and where we use the notation 

rT 



\P\ = \P%-)\,= [ \P%s)\ds. 
Jo 



It remains to check that the right hand side goes to zero as e tends to 0. 
Let us recall that 



P'is) 



C Vy^is, XI, Ys + a(y/ - Ys), Zs)Gs da - Vy^{s, r,)G, 
Jo 

[ {Vy^is, Xl,Ys + a(y/ - Ys), Zs) - Vyil^{s, Ts)) da, 
Jo 



so that 

da 



'{s)\< f\u%a,s)\ 
Jo 



with u'{a, s) = {Vyijis, XI, Y, + a(y/ - Y,), Z^) - Vy^Pis, T,)) G,. 

We consider the product space [0,1] x [0, T] x 0, with the measure A (8) A P where A is the 
Lebesgue measure. Since '>p{s, •, •, •) belongs to Q^'^'^, u^{s, a) goes to zero in A A (8)P-measure 
by continuity of ^ and we have, 

\u^a,s)\ < K{q{s) + \Zs\^ + \Xsr + \Xir + \Ysr + \Y,T)\Gs\ 

< K {q(s) + \Z,f + + \X^\Z + 11^1^ + 11^1^) IGloo. 

First of all, let us recall that |G|oo belongs to UiVC) and that q G L^(0,T) and \Z^ belongs 
to Wl'^. Moreover, Y^ converges to Y in S^{K), X'' converges to X in so that 

{|^^loo}e>o uniformly integrable in L^/^ and {|-^'^|^}£>o uniformly in ^pC^+i)/™, Since 
wehaveH| = ^<l, 7 + H^<landH^ = ^^^^^ the right 
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hand side of the previous inequahty is uniformly integrable as a function of the three variables 
{a,s,uj). In particular, \P^\i converges to in probability as e goes to zero. Moreover we have 

\p% <K{i + \z\i + \x\z + ix^is + riSo + \yroo) \G\oo. 

Since |G|oo is in U we have only to check that the RHS of the previous inequality is uniformly 
integrable in L^^ where a = r/[r — p) is the conjugate exponent of r / p to prove that \P^\i tends 
to in LP as e goes to 0. Let us observe that 



pa = r -. r- = r mm — , — = mm , 

l_niin(4^,^) V" 2; \np, 2 

As we said before l-^ll G L^''^ C L'"^, is uniformly integrable in Ul'^ and r /n = p/np* > pa 

and I^^IJJ is uniformly integrable in 7;,p{™+i)/"^ and pa < p/2 < p{l + 1/m). Thus \P'^\i goes 
to in LP. 

The term can be treated exactly in the same way as we did for P^. Indeed, we have 



/ V^V(s, + aeNs,Ys, Zs)N, da - V^i^is, r,)iV, 
Jo 

[ (V^s, Xs + aeN,, Y„ Z,) - V^V'(s, T,)) iV, da, 
Jo 



VxV' satisfies the same growth condition as \7y^l^ and N belongs to (iJ) which is a better 

situation than the previous one where we have only G £ S^{K). 
Let us see that \Q^\i goes to in LP as e goes to 0. We write 

Q'{s) = [\,i^{s,Xl,Y,',Zs + a{Zl- Zs))Hsda-V,i^{s,Ts)Hs 
Jo 

= [ {V,tl;{s,Xl,Y,',Zs + a{Zl-Zs))-V,tP{s,Ts))Hsda. 
Jo 

Since V'Cs, •,-,•) is g^^^'\ v%s,a) := {V ,i;{s, XI,Y,' , Z^ + a{ZI - Z^)) - V,il;{s,Ts)) goes to 
zero in A A (8> P-measure and since ip is Lipschitz with respect to z, we have a)\ <2L \Hs\. 
Taking into account the fact that H belongs to the space M"^ {L2{'^, K)), we deduce that 
goes to in L^{{0, 1) x (0,r) x Q,). In particular, IQ^I^ goes to in probability. We have also 
IQ^Ii < 2LVf\H\2 and since \H\2 belongs to L^ C LP, the bounded convergence theorem gives 
lim,^o|||Q"lillp = 0. 

Thus we have proved that (G, H) = V(x,5)^(^, C) in K^^- 

By linearity, it follows directly from 1)3. 6|) . that (iV, C) — ^ {C!,H) is continuous from 
to /C^'. Let us prove that (X,^) — > {G,H) is continuous from to K,p . Let us consider 
(G, H) G /C^ and {C , H') G K7 the solutions to ^ associated to {X, G XP and {X' , e 
{{N,C,) is fixed in A'^). Once again, using the a priori estimates in we have 



\\{G,H) - {G',H')\\^ < C [\\\P\r\l + |||Q|i||^ + (3.7) 

for a suitable constant G where we have set 

P{s) = {Vyi,{s,X'„Y'„Z',)-Vyi,{s,Xs,Ys,Z,)]Gs, 
Q{s) = {V,il;{s,X'„Yl,Z'^ -VMs,Xs,Ys,Zs)}Hs, 
R{s) = {V^iP{s,X'^,Y^,Z'^ -V,iP{s,Xs,Ys,Zs)}Ns. 
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If {X',C') — > in XP then {Y',Z') — > iY,Z) in and, since ^Jj{s, ■,-,■) belongs to 

arguing exactly as we did to show the Gateau-differentiability of <I>, the right hand side of ()3.7() 
tends to 0. 

In conclusion, <I> belongs to {X^^IC^). □ 

Remark 3.4. This result can be rewritten in the following way. 

Let p > 1 and let us define p = p max ((n + l)p^,,p^, + 2) where = max(2, n) + Then 
the map (X,^) — > {Y{X,^), Z{X,C)) from XP to /C is in G^. 



4 The forward-backward system 

In this section, we apply the previous results on the differentiability of BSDEs to study the 
differentiability of the solution to the forward-backward system (jl.lj) ~ (jl.2j) . 
We start by recalling some results on the solution to the forward equation. 



4.1 The forward equation 

Let us recall that {^t}tg[oT] ^ cylindrical Wiener process with values in a Hilbert space H, 
defined on a probability space {0,,J-,¥). We fix an interval [t,T] C [0,T] and we consider the 
Ito stochastic differential equation: 

dXr = AXrdT + F{T,Xr)dT + G{T,Xr)dWr, T & [t,T], 

Xt = x£H. ^ ^ 

We assume the following: 

Hypothesis A. 2. (i) The operator A is the generator of a strongly continuous semigroup e*^, 
t > 0, in the Hilbert space H. 

(ii) The mapping F : [0, T] x H ^ H is measurable and satisfies, for some constant L > 0, 

\Fit,x)-F{t,y)\ < L\x-y\, t e [0,T], x,y e H, 
\F{t,x)\ < + tG[0,T],xeH. 



(iii) G ■.[0,T] X H — > L{E, H) is such that, for every u e H, the map Gv \ [Q,T] x H ^ H is 
measurable, e^'^G{t,x) € L2(H,i/) for every s > 0, t G [0, T] and x G H, and 

|e^^G(t,x)|i,(=^) < Ls-^{l + \x\), 

\e'^G{t,x)-e'^G{t,y)\L,i^^H) < Ls-^\x-yl 
\G{t,x)\Li^^H) < L{l + \x\), 

for some constants L > and 7 G [0, 1/2). 

(iv) For every s > 0, t £ [0,T], 

F{t,-)€g\H,H), e'''G{t,-)€G\H,L2{E,H)). 

By a solution of equation (|4.H) we mean an (.Ff)-predictable process Xr, r G [t,T], with 
continuous paths in H, such that, P-a.s. 

= e(^~*)^x+ re(^~'^)^F(a,X„) da + e'-^-''^^G{a,X^) dW^, r G \t,T\. (4.2) 
Jt Jt 
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To stress the dependence on initial data, we denote the solution by X{T,t,x). Note that 
X{T,t,x) is -measurable, hence independent of J^f A consequence of the previous assump- 
tions is that, for every s > 0, t G [0,T], x,h £ H, 

\VxF{t,x)h\ < L \hl \Vx{e'^G{t,x))h\L,(^^H) < L 

The following results are proved by Fuhrman and Tessitore in [7j. 

Proposition 4.1. Under the assumptions of Hvvothesis lX~^ (i)-(ii)-(iii). H4.1|) has a unique 
solution X . For every p > 1, X belongs to S^{H) and 



E 



sup,g[,,^] <C{l + \x\y, (4.3) 



tAi 



for some constant C depending only on p,'j,T, L and M := sup,-g[o,T] k 

To go further, we need to investigate the dependence of the solution X(t, t, x) on the initial 
data X and t. We first reformulate equation (|4.2j) as an equation on [0,T]. We set 

S{t) = e^^ for r > 0, 5(r) = / for r < 0, 

and we consider the equation 

Xr = S{T-t)x+ r ^^t]{^)S{t - a)F{a,X^) da + f ^^T]{<y)S{T - <j)G{a,X„) dW„, (4.4) 
Jo Jo 

for the unknown process X-r, r G [0, T]. Under the assumptions of Hypothesis IA.21 equation 
(|4.4|) has a unique solution X G S'^{H) which belongs to S^{H) for every p £ [1, oo). It clearly 
satisfies Xr = x for r G [0,t), and its restriction to the time interval [t,T] is the unique solution 
of (|4.2)) . From now on we denote by X{T,t,x), t G [0, T], the solution of (|4.4j) . 



Proposition 4.2. Assume Hypothesis \A . 3L Then, for every p > 1, the following hold. 
(i) The map {t,x) ^ X{;t,x) belongs to g°'^([0,T] x H,SP{H)). 



(ii) For every h £ H, the directional derivative process V xX{T,t, x)h, r G [0, T], solves the 

equation: 

VxX{T,t,x)h = e(^-*)^/i + J e^^-''^^VxFia,X{a,t,x))VxXia,t,x)hda 

+ J V,(e("-")^G(a, t, x)))V,X(ct, t, x)h dW^, r G [t, T], 
VxX{T,t,x)h = h, rG[0,t). 

(iii) Finally \\'VxX{T,t,x)h\\^ < c\h\ for some constant c. 



4.2 The backward equation 

With this result in hands, we are know in position to study the regularity with respect to (t, x) 
of the solution (i^(r, t, x), Z{t, t, x)) to the BSDE 

Yr + j^ Z„dW„ = <PiXiT,t,x))+ i^ia,Xia,t,x),Y„,Z„)da. (4.5) 

We assume that ip : [0,T] x H x K x L2{'^,K) K verifies Hvpothesis lA.ll On the function 
(p : H ^ K we make the following assumptions: 
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Hypothesis A.3. (i) cp G g^{H,K). 

(ii) There exists C > and m > such that, 

yx£H, yheH, |V:,.(/>(x)/i| <C7|/i|(l + |x|"'). 

Under the assumptions of Hypotheses IA.2I and lA.H IA.3I by Propositions 14.11 and 1,3.21 there 
exists a unique solution of 1)4. 5|) that we denote by {Y{t, t, x), Z(t, t, x)), t £ [0, T]. This solution 
belongs to /C^ for each p > 1. 

Let us recall that the X{-, t, x) yj-measurable, so that Y{t, t, x) is measurable with respect 
to J^[t^T] ™d Tt; it follows that Y{t,t,x) is indeed deterministic (see also 0). 

For later use we notice two useful identities: for t < s <T the equality: P-a.s., 

A(r, s, X{s, t, x)) = X{t, t,x), r G [s, T], 

is a consequence of the uniqueness of the solution of 1)4. 2|) . Since the solution of the backward 
equation is uniquely determined on an interval [s, T] by the values of the process X on the same 
interval, for t < s <T we have, P-a.s., 

Y{T,s,X{s,t,x)) =Y{T,t,x), forrG[s,r], (4.6) 

together with 

Z{t, s, X{s, t,x)) = Z{t, t, x) for a.e. r G [s,T]. 

To investigate regularity properties of the dependence on t and x, we notice that the solution 
{Y{a,t,x), Z{a,t,x)) of the backward equation in (|4.5j) can be written, with the notation of 
Propositions 14.21 and 13.21 as 

{Y{;t, X), Z{; t, X)) = CD {Xi;t, x),(p{X{T, t, x))) . 

Moreover, as a consequence of Hvpothesis IA.31 it can be easily proved that ^ i-^ belongs to 
the space every p G [l,oo). The following Proposition is then 

an immediate consequence of Propositions 14.11 14.21 and 13.21 and the chain rule for the class G, 
stated in Lemma 12.21 

Proposition 4.3. Assume Hvvotheses \A.3L\A.1\ and \A . 51 

Then the map {t, x) ^ {Y{-,t, x), Z{-, t, x)) belongs to ^"^'^([O, T]x H , ICp) for all p G (1, oo). 

Denoting by VxY , VxZ the partial Gateaux derivatives with respect to x, the directional 
derivative process in the direction h £ H, {'VxY(T,t,x)h,'VxZ(T,t,x)h}^i-^Qrp-^ solves the equa- 
tion: P-a.s., for T G [0,T], 

VxY{T,t,x)h + j VxZ{a,t,x)h dWa 

= Vcp{X{T, t, x))VxX{T, t, x)h 

+ / Vx'<l^{<^-,X{a,t,x),Y{a,t,x),Z{a,t,x))VxX{a,t,x)h da 
+ / Vyip{a, X{a,t, x),Y {a,t, x), Z{a,t, x))VxY{a,t, x)h da 
■ / V zil^icT, X{a,t,x),Y {a,t,x), Z{a,t,x))'VxZ{a,t,x)h da. 



+ 
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Finally the following estimate holds, for each p > 1 : 



E 



sup \VccY{T,t,x)h\P + ( [ \VccZ{a,t,x)h\'^ da 
re[o,T] V^o 



p/2- 



1/p 



< C\h\{l + \x 



(m+l){nV2)^ 



for a constant C depending on p, fj,, T and L. 



Proof. The first two statements comes from the chain rule for the class Q. The final estimate 
follows from (|3.5j) applied with 

X = X{;t, x), N = V,X{;t, x)h, C = <P{X{T, t, x)), C = V(b{X{T, t, x))V,X{T, t, x)h, 

taking into account that by Propositions 14. 1 1 and 14.21 we have 



\N\ 



oo,p 



<c\h\, < C(l + |x|), 



and, by Hypothesis lA. 31 we also obtain ||^||p < c(l + |x|)'"+-'^, ||C||p < c\h\{l + |x|)™ for a suitable 



constant c. 



□ 



5 Application to nonlinear PDEs 

5.1 The nonlinear Kolmogorov equation 

We denote by Bp{H) the set of measurable functions (p : H ^ M. with polynomial growth, i.e. 
such that sup^.gj:^ |0(x)|(l + |x|°)~^ < oo for some a > 0. 

Let X{T,t,x), T £ [t,T], denote the solution of the stochastic equation 



,{T-t)A 



X 



where A, F, G, satisfy the assumptions in Hypothesis IA.21 The transition semigroup Pt^r is 
defined for arbitrary (p G Bp{H) by the formula 



Pt,,M(x) =E[0(X(r,t,x))] 



x£ H. 



The estimate Ksup^gj^^-] \Xt-\^ < C(l + |x|)^, see ()4.3() . shows that Pt^r is well defined as a 
linear operator from Bp{H) into itself; the semigroup property Pt^sPs,T = Pt,T, t < s < t, is well 
known. Let us denote by Ct the generator of Pt^r- 



J^tMx) = ^Trace {G{t,x)G{t,x)*V^4>{x)) + {Ax + F{t,x),V(l){x)), 

where Vcp and V^</> are the first and the second Gateaux derivatives of (p (identified with elements 
of H and L{H) respectively). This definition is formal, since the domain of Ct is not specified; 
however, if (p is sufficiently regular, the function v{t, x) = Pt^T[(p]{x)t is a classical solution of the 
backward Kolmogorov equation: 

dtv{t,x) + Ct[v{t,-)]{x) t G [0,r], X E iJ, v{T,x) = (p{x), x e H. 

We refer to W and |21j for a detailed exposition. When (p is not regular, the function v defined 
by the formula v{t,x) = Pt^T[4']ix) can be considered as a generalized solution of the backward 
Kolmogorov equation. 
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Here we are interested in a generalization of this equation, written formally as 

r dtu{t,x)+Ct[u{t,-)][x)+i:{t,x,u{t,x),G{t,xyV^u{t,x)) = d, t e [0,T], x e H, 

\ u{T,x)=(t){x). ^ > 

We will refer to this equation as the nonlinear Kolmogorov equation, ij: : [0, T] x x M x H ^ M 
is a given function verifying (|A.1|) and Vxu{t, x) is the Gateaux derivative of n(t, x) with respect 
to x: it is identified with an element of H, so that G{t,x)*'Vxu{t,x) £ H. 

Now we define the notion of solution of the nonlinear Kolmogorov equation. We consider 
the variation of constants formula for (|5.1j) : 

u{t,x)=j^ Pt,rmT,-,u{T,-),G{T,-rVMr,-mx)dT + Pt,Tmx), te[0,T],xeH, (5.2) 

and we notice that this formula is meaningful, provided ^(t, •,-,•), u{t,-) and 'Vxu{t,-) have 
polynomial growth. We use this formula as a definition for the solution of (|5.H) : 

Definition 5.1. We say that a function u : [0,T] x H ^ M is a mild solution of the nonlinear 
Kolmogorov equation H5.1|) if the following conditions hold: 

(i) ueg^'H[0,T] xF,M); 

(ii) there exists C > and d e N such that \Vxu{t,x)h\ < C\h\{l + for all t £ [0,T], 

X € H, h £ H; 

(iii) equality H5.2|) holds. 

Remark 5.2. An equivalent formulation of (|5.H) or 1)5.2(1 would be the following: we consider 
the Gateaux derivative 'Vxu{t,x) as an element of H* = L(H,]R) = L2{'^,^), we take a function 
ip : [0, T] X H X M X ^2(^5 M) ^ M and we write the equation in the form 

dtu{t, x) + Ct[u{t, •)]{x) + ip{t, X, u{t, x),Vxu{t, x)G{t, x)) = 0. 

The two forms are clearly equivalent provided we identify H* = L2(H,M) with H by the Riesz 
isometry. This will be done in the sequel. In particular, although we keep the notation in (|5.1|) . 
we will sometimes consider ^ as a real valued function defined on [0, T] x H x x L2(H,M), 
satisfying Hvpothesis lA. II with IT = M. 

We are now ready to state the main result of this section. 

Theorem 5.3. Assume that Hvvothesis \A.Si \A.li (with K = R) and \A.3\ hold. 

The nonlinear Kolmogorov equation \5. 1\) has a unique mild solution u given by the formula 

u{t, x) = Y{t, t, x), {t, x) G [0, T]x H 

where {X,Y,Z) is the solution of the backward-forward system i4.5\ ). Moreover, we have, ¥-a.s. 

Y{s,t,x) = u{s, X{s,t,x)), Z{s,t,x) = G{s, X{s,t, x))*Vxu{s,t, X{s,t, x)). 

Proof. Let us first recall a result of [71 Lemma 6.3]. Let {ej} be a basis of H and let us consider 
the standard real Wiener process = Jq {ei, dW^) , r > 0. 

If G t/'^'^([0,T] X H,'K), for every i, the quadratic variation of u{s, X{s,t,x)) and is 
given by 

[vi;X{;t,x),W']^ = J\xv{T,X{T,t,x))G{T,XiT,t,x))e^ dT, sG [t,T]. (5.3) 
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(a) Existence. As we pointed out before, for s € [t, T], y(s,t, x) is JP"^^ ,5] -measurable so that 
y (i, t, x) is deterministic. Moreover, as a byproduct of ProDosition l4.3l the function u defined by 
the formula u{t,x) = Y{t,t,x) has the regularity properties stated in Definition 15.11 It remains 
to verify that equality (|5.2j) holds true for u. 

To this purpose we first fix t £ [0,T] and x £ H. Since {Y{-,t, x), Z(-,t, x) solves the 
BSDE (jiini)), we have, for s G [t,T], 

Y{s,t,x)+ 1 Z{T,t,x)dWr = (l)[X{T,t,x)) + 1 ij(j,X{T,t,x),Y{T,t,x),Z{T,t,x)^ dr, 



(5.4) 



and, taking expectation for s = t we obtain, coming back to the definition of u and Pt^T, 



uit,x) = Pt^Tmx)+E 
Moreover, we have, for each i, 



■ip(^T, X(r, t, x), Y{t, t, x), Z(t, t, x)^ dr 



[Yi;t,x),W']^ = l\Zr,ei)dT, se[t,T]. 
Now let us observe that from the Markov property ()4.6() we have, P-a.s., 

u{T,X{T,t,x)) =Y{T,t,x), Te[t,T]. 

It follows from 1)5. 3|) that, for each i, 

[Y{;t, x), W'] ^ = V,n(r, X{t, t, x))G{t, X{t, t, x))ei dr, s G [t, T]. 

Therefore, for a. a. r G [t,T], we have P-a.s. 

Vxu{T,X{T,t,x))G{T,X{T,t,x))ei = {Z{T,t,x),ei), 
for every i. Identifying Vxuitjx) with an element of H, we conclude that for a. a. r G [t,T], 

G{t, X{t, t, x))* Vx.u(t, t, X{t, t, x)) = Z{t, t, x). 
Thus, ip (r, X{t, t, x),Y{t, t, x), Z{t, t, x)) can be rewritten as 

^P (r, X(r, t, x), n(r, X(r, t, x)), G(r, X{t, t, x))* V,u(r, X{t, t, x))) 
and (|5.4|) leads to 



{t,x)=Pt,Tmx)+ / Pt,,[V(r,-,n(r,-),G(r,-rV,n(r,-))](x)dr 



which is ((SI2I)- 



(b) Uniqueness. Let u be a mild solution. We look for a convenient expression for the process 
u{s, X{s,t, x)), s G [t,T]. By (|5.2|) and the definition of Pt^r, for every s G [t,T] and x G H, 

u{s,x) = E[(p{X{T,s,x))] 



+E 



T 



^[t, X{t, s, x),u{t, X{t, s, x)), G{t, X{t, s, x))*Vxu{t, X{t, s, x)))dT 
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Since X{t,s,x) is independent of J^s, we can replace the expectation by the conditional 
expectation given Ts- 

u{s,x) = E^'[(j){X{T,s,x))] 

i{;{t, X{t, s, x),u{t, X{t, s, x)), G{t, X{t, s, x))*Vxuir, X{t, s, x)))dT . 



s 



Taking into account the Markov property of X, P~a.s. 

X{t, s, X{s, t, x)) = X{t, t, x), T G [s, T], 

we have 



u{s, X{s, t, x)) = E-^^ [(t>{X{T, t, x))] 

X{t, t, x)),G{t,X{t, t, x)yVMr, ^(r, t, x))) dr 
If we set 

^ = (/)(X(r, t, x)) + ip^T, X{t, t, x),u{t, 

the previous equality leads to 
u{s, X{s, t, x)) 

= E^^ [e] - X{t, t, x), u{t, X{t, t, x)),G{t, X{t, t, x))* V,tx(T, X{t, t, x)))dr. 

Let us observe that E-^*[^] = u{t,x). Since ^ G L^(r2;]R) is ^[j^T^pmeasurable, by the repre- 
sentation theorem, there exists Z G Lp{Q x [t, T]; L2(H, R)) such that 



E^'l^] = u{t,x) + ZrdWr, SG[t,T]. 



We conclude that the process u{s, X{s,t, x)), s £ [t,T] is a (real) continuous semimartingale 
with canonical decomposition 



u{s,X{s,t,x)) = u{t,x) + J ZrdWr (5.5) 

- ^ V(t, X(t, t, x), n(T, X(t, t, x)), G(r, X(t, x))* V^u(t, X(t, t, x))) dr. 

Using (|5.3() and arguing as in the proof of existence, we deduce that for a.a. r G [t, T], F-a.s. 

G{T,X{T,t,x)yVMr,XiT,t,x)) = Zr. 
Substituting into 1)5. 5() we obtain 

u{s,X{s,t,x)) = u{t,x) + G{T,X{T,t,x)yVxu{T,X{T,t,x))dWr 

iP{t, X{t, t, x),u{t, X{t, t, x)), G(t, X{t, t, x))* V^u(t, X{t, t, x))) dr, 

for s G [t,T]. Since u(T, X{T,t,x)) = (j){X{T,t, x)), we deduce that 

{ (u(s, X(s, t, x)), G(t, X(t, t, x))* V^u(t, X(t, t, x))) j^^^^^^j 

solves the backward equation (|4.5j) . By uniqueness, we have y(s, t, x) = ii(s, X(s, t, x)), for each 
s G [t,T] and in particular, for s = t, u{t,x) = Y{t,t,x). 

□ 
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5.2 Application to Optimal Control 

We wish to apply the above results to perform the synthesis of the optimal control for a general 
nonlinear control system. 

Fixed t £ [0,T] and x & H an admissible control system (a.c.s) is given by (r2,f,^(,P, Wt,u) 
where 

• {Q, £, P) is a probability space, 

• {J^t : t > 0} is a filtration in it, satisfying the usual conditions, 

• {Wt : t > 0} is a cylindrical P- Wiener process with values in H and adapted to the filtration 

• u £ X [t,T];U) satisfies the constraint: Ut € U P-a.s. for a. a. t £ [t,T], where U is 
a separable real Hilbert space and U is a fixed subset of U. 

To each a.c.s. we associate the mild solution X" E Cp([t, T]; ff)) of the state equation: 

dX^ = AXJ^dT + F{T,XJ^)dT + G{T,X^)[r{T,X^,Ur)dT + dWr], T £ [t,T], 

Xt = xeH. ^^-^^ 

and the cost: 
J{t, X, u) 

E / exp f / A(r, X'f,Ur)dr\ l{s, Xf, u(s)) ds + exp f / A(r, X^,Ur)dA 



t / \Jt 



where A, / and <I> are real functions. A may be called the discount function. 

Our purpose is to minimize the functional J over all a.c.s. Notice that in this problem the 
discount A depends on the control u. We define the Hamiltonian function relative to the above 
problem: for alH G [0,T], x £ H, y G W and z £ E 

ip{t, x, y, z) = inf {/(t, x, u)+ < z, r{t, x, u) >= +\{t, x, u)y : u £ U} . (5-7) 

We make the following assumption. 

Hypothesis A. 4. The following holds: 

1. A,F and G verify Hvpothesis IA.21 

2. r : [0,T] X H X U ^ 3 and there exists a constant C > such that 

\r{t,x,u)\^ < C 

3. I : [0,T] X H X U ^ M satisfies the following condition 

< l{t,0,u) < qi{t) + h{u), 
for some functions qi £ L^{0,T) and h : lA — > M+; 

4. A : [0, T] X X ^ ^ M is a non positive function; 

5. (j) satisfies Hvpothesis IA.3I 
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6. V : [0,T] X F X M X H ^ M is measurable and, for a G [0,r], ^{a, ■, •, •) G G^'^'^^H x M x H) 
with 

\V^i>{a, X, y,z)\ + \Vy^{a, x, y,z)\< q{a) + c (|xr + 1^1" + kP) 
where q is in L^(0,T). 

7. For ah t G [0,T], x G i/, y G ffi and z G H there exists a unique T{t,x,y, z) G that 
reahzes the minimum in H5.7() . Namely 

X, y, z) = l{t, X, r(t, X, y, z))+ < z, r{t, x, r(t, x, y, z)) > +A(t, x, r(t, x, y, z))y. 

Moreover the map F : [0, T] x x M x H — > U is measurable. 

Remark 5.4. The function if) : [t, T] x x M x H ^ M verifies HvDothesis lA.il In particular, the 
Hypothesis IA.41 -2. implies that il) is Lipschitz with respect to z. The condition IA.41 -3. implies 
the HvDothesis lA.ll (w). Finally, it follows from IA.41 -4. that ijj is nonincreasing so that we can 
take /i = in Hypothesis lA.ll (ii). 

Thus, if we identify H with L2(H, M), the real function ij; defined on [t, T] x i7 x M x L2(H, M) 
verifies Hypothesis lA.ll with = M. Therefore by Theorem 15.31 the Hamilton Jacobi Bellman 
equation 

^^^^ + Ct[v{t, ■)]{x) + X, v{t, x),G{t, xyVMt, x)) = 0, te[0,T],xeH, 
v{T, x) = (j){x). 

admits a unique mild solution v G g°''^{[0,T] x H). 

Example 5.5. Let us consider the following situation: U = R, U = M+ and r{t,x,u) = 0, 
l(t,x,u) = \(t,x,u) = —u. Then we have 

i;{t,x,y,z) = -^yl, r{t,x,y, z) = y+. 

We see on this simple example that the Hamiltonian function ip is not Lipschitz with respect to 
y but nonincreasing with a polynomial growth order. 

We are in a position to prove the main result of this section: 

Theorem 5.6. Assume Hypothesis \A.4\ For all a.c.s. we have J{t,x,u) > v{t,x) and the 
equality holds if and only if the following feedback law is verified by u and X".' 

u{a) = T{a,X^,v{a,X^),Gia,X:)VM'^,X:)), P - a.s. for a.a. a G [t, T]. (5.8) 

Finally there exists at least an a.c.s. for which i5. ^) holds. In such a system the closed loop 
equation: 

dXr = AXr dr + F(r, X^) dr + G(r, Xr) dWr 

+ G(r, Xr)r{T, Xr,T{T, Xr,viT, X,), G{t, Xr)VMr, Xr)))dT 

Xt = xeH. 

admits a solution and ifu{a) = F((T, X^-, f (o", Xg-), G((T, X(j)V2,-w(cr, Xg-)) then the couple {u,X) 
is optimal for the control problem. 
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Proof. For all a.c.s., setting u{s) = for s < t, the Girsanov theorem ensures that there exists 
a probability measure P on J7 such that 



Wt:=Wt+ / r{a,X^,u^)da 
Jo 

is a P- wiener process (notice that the function r is bounded). Relatively to W equation (|5.6(1 
can be rewritten: 

dX^ = AX'^dT + F{T,Xj^)dT + G{T,X^)dWr, Te[t,T], X^=x€H. 

The process X" turns out to be adapted to the filtration J^t generated by W and completed in 
the usual way. In the space {^},£,{J-t},^), we can solve the SDE 

X{t, t, x) = e(^-*)^x + / e(^-'")^F(cj, X{a, t, x)) da + e^^-'''^^G{a, X(cj, t, x)) dW„ 

Jt Jt 

and then the BSDE 

Y{T,t,x) = (j){X(T,t,x)) + j ij{a,X{a,t,x),Y{a,t,x),Z{a,t,x))da - j Z{a,t,x)dW^. 
Actually, this construction can be done for arbitrary t G [0, T] and x £ H. Let us set 
VrG[t,T], = exp ( / X (r, X{r,t,x),Ur] dr \ . 



We have 

dDrY{T, t, x) = Dr |A(r, X{t, t, x),Ur)Y{T, t, x) - iI){t, X{t, t, x), Y{t, t, x), Z{t, t, dr 

+DrZ{T, t, x)dWr 

and thus 

DT<t){XT) = Y{t,t,x)+ [ DrZ{T,t,x)dWr 



+ / Dr{XiT,XiT, t, x),Ur)Y{T, t, x) - ^'(r, X{t, t, x) , Y{t, t, x), Z{t, t, x))}dT 



We notice that X{a,t,x) = X^ and coming back to the original Wiener process we get: 

DT(t){X^) = Y{t,t,x) + j^ Dr\^Z{T,t,x)r{T,X:^,Ur)dT + Z{T,t,x)dWr} 

+ j^^ Dr {A(r, X", Ur)Y{T, t, x) - ^{t, X^r. ^ ij , t, x), Z(r, t, x))] . 

Now, from Proposition 15.81 we have Y{T,t,x) = X") and 

Z(r, t, x) = G{t, X{t, t, x))*VMr, X{t, t, x)) = G(r, Xj^yVM^, XJf). 

Taking expectation with respect to the original probability P in the previous relation we obtain: 

E [DTHXT)]-<t,x) 
rT 



E 

+E 



^ D^ {X{a, X:,u^)v{a, X^) - X:,v{a, X^), G{a, X^)* V,t;(a, X^)) da} 
£ D,G{a, X^yVM'^, K))r{a, X^, u^) da 
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Adding to both hand side the term 



E 



^ DJia,X^,u^)da 



we get to the fohowing expression 



^ D^H{a,X:^,v{a,X:^),G{a,X:^rVM<^,K),Ua) da 



J{t, X, u) — v{t, x) = E 

where we have set 

H{a, X, y, z, u) = —il^{(J, x, y, z) + A((T, x, u)y + zr{a, x, u) + l{a, x, u) 

The above equahty is known as the fundamental relation and immediately imphes, by definition 
of ^ that v{t,x) < J{t,x,u) and that the equality holds if and only if (|5.8j) holds. 

Finally the existence of a weak solution to equation (|5.9|) is again a consequence of the 
Girsanov theorem. Namely let X G Cp{[t, T]; L'^{Q; H)) be the mild solution of 

dXr = AXr dr + F(r, Xr) dr + G{t, Xr) dWr, 
Xt = X, 

and let P be the probability on Q. under which 



ria, X^,ria, X,, r(a, X„, X^yV^^, X^)) da + Wt 



is a Wiener process (r is bounded) . Then X is the mild solution of equation ()5.9() relatively to 
the probability P and the Wiener process W . □ 
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